Linear Ridge Estimator of High-Dimensional Precision Matrix Using Random Matrix Theory
نویسندگان
چکیده
In estimation of the large precision matrix, this paper suggests a new shrinkage estimator, called the linear ridge estimator. This estimator is motivated from a Bayesian aspect for a spike and slab prior distribution of the precision matrix, and has a form of convex combination of the ridge estimator and the identity matrix multiplied by scalar. The optimal parameters in the linear ridge estimator are derived in terms of minimizing a Frobenius loss function and estimated in closed forms based on the random matrix theory. Finally, the performance of the linear ridge estimator is numerically investigated and compared with some existing estimators.
منابع مشابه
A New Ridge Estimator in Linear Measurement Error Model with Stochastic Linear Restrictions
In this paper, we propose a new ridge-type estimator called the new mixed ridge estimator (NMRE) by unifying the sample and prior information in linear measurement error model with additional stochastic linear restrictions. The new estimator is a generalization of the mixed estimator (ME) and ridge estimator (RE). The performances of this new estimator and mixed ridge estimator (MRE) against th...
متن کاملShrinkage Estimation of Large Dimensional Precision Matrix Using Random Matrix Theory
This paper considers ridge-type shrinkage estimation of a large dimensional precision matrix. The asymptotic optimal shrinkage coefficients and the theoretical loss are derived. Data-driven estimators for the shrinkage coefficients are also conducted based on the asymptotic results from random matrix theory. The new method is distribution-free and no assumption on the structure of the covarianc...
متن کاملEstimation in High - Dimensional Linear Models with Deterministic Design Matrices
Because of the advance in technologies, modern statistical studies often encounter linear models with the number of explanatory variables much larger than the sample size. Estimation and variable selection in these high-dimensional problems with deterministic design points is very different from those in the case of random covariates, due to the identifiability of the high-dimensional regressio...
متن کاملHigh Dimensional Multivariate Regression and Precision Matrix Estimation via Nonconvex Optimization
We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the nonconvex estimator, and it attains a linear rate of convergence to the true regression coefficients and precision matrix simultaneously, up to the statistical ...
متن کاملSpectrum estimation for large dimensional covariance matrices using random matrix theory
Estimating the eigenvalues of a population covariance matrix from a sample covariance matrix is a problem of fundamental importance in multivariate statistics; the eigenvalues of covariance matrices play a key role in many widely techniques, in particular in Principal Component Analysis (PCA). In many modern data analysis problems, statisticians are faced with large datasets where the sample si...
متن کامل